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' Examination the Aptifi^es . . . Evaluation System 



Educational Importance of the Study 

Currently there is a need for new assessment tools for use in 
c^ajeer education, vocational training,' and special education programs* 
Many school systems have begim using work samples as supplementary 
tools to assess vocational abilities because of the unique advantages they 
offer. First of all, their face validity makes them appealing to students 
who feel threatened by, or have ^en turned off by, traditional paper and 
pencirtests. secondly, as has' been demonstrated in this study, work ^ 
. samples can be designed^o be relatively independent ^of verbal skills; 
^ hence, they are particularly useful for assessing speci^c aptitudes of 
students who have poor reading skills. Finally, because of the ''real- 
life'^ nature of work sample tasks, the task of assessing student's 
suitability for specific, careers and/or special vocational curricjula is 
made eas.ier; and tlie lask of counseling becomes more direct and 
straightforward. 

Of course, any' tests used for vocational pui^poses must 
be psychometrically sound and must^emonstrably measure specific, 
' relevant aptitudes. With these considerations in mind, the content 
of the different Micfo-TOWER work- samples was carefully selected; 
and standardized methods of group administi^ation and objective scoring . 



were developed. Tramtionally, ip the field of vocational rehabilitation 
Wer^ wbrk'sp^mples h^ve been used the most, little atl!l(ation has been 
paid to these piSychometric issues* However, the results reported 
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here demonstrate that when concern is given to psychometric issijes 
in designing i new work sample system, satisfactory measurement 
properties can be obtained; thus rendering the work sample approach 



an attr^ctute one to the field of^education. 
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Summary ^ , 

Educators have 'been looking for new tests for use in career 
education and special education programs, and interest has increasingly been 
directed toward work samples. A new battery of work samples, called Micro- 
TOWER, ,has been designed to measure verbal, nupierical, and perceptual 
niotor skills. TheTpurpose of thig study was twofold: to examine the con- 
struct validity of these work samples, and to assess the extent to whiph 
reading ability affects performance. Results indicate that, with few excep- 
tions, the work sampled do measure those skills they were designed to 
Measure; in addition, reading ability is minimally involved. ' 



Examination of th.e Aptitudes Measured by 
Work Samples in the Micro -TOWER Evaluation System' 

The purpose of thi.s study was to examine evidence relating to the ' 
construct validity of the new bajttery of work ff^ples known as Micro-TOWER. 
•The thirteen Micro-TOWER work samples were designed to measure major' 
aptitudes important in vocatioftal education, training and placement. Tradition- 
ally, most work samples have been designed t'o measure specific abilities re- 
quired'for specific jobs. The Micro-TOWER battery, however, is essentially 
an aptitude battery, comprised of work. samples or performance ^tests. At tha. 
same time, these .tests have high face validity in that each resembles actual 
work tasks • . / 

• ■ • - ■ \ • 

' The present study has a twofold purpose-\T6 see if the work 
saonples do indeed measure those abilities .tliat they were designed to measure; 
and related to this, to see if the level of reading comprehension, has been kept 
to a minimum in those work samples designed to measure nonverbal skills. 

* < . *' • " 

The Micrp-TOiWER System 
T ^ » 

, •• ■ > «> 

The Micro-TOWER System of Vocational Evaluation waS developed 

at the-lCD Rehabilitation and Research Center. T^he system was field tested in 

197^ in 18 sites around the country, including rehabilitation centers, prisons, 

schools, and psychiatric hospitals, Tlje field testing wai funded by a grant from 

the Rehabilitation Services Administration of HEW. 
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* . ♦ ♦ 

^ . ' 'The^ysteta includes thirteen work samples, as well as group 
discussion sessions aft^ presentations of occupational information. The \\jork ^' 

A 

samples are.usually administered to small giroups and a complete evaluation • 
can be completed in a period of trom two to fi^e days. Instructionis and scor- 
ing procedures^ are standardized. The work samples and the aptitude areas 
they were designed to assess are presented in Table 1. ^ 

Each work simple has a, practice period followed by an evaluation 
period,. The' instructions are on cassette tape, however, during the practice 
period the evaluator can stop the tape whenever it \s necessary to further ex- 
plain or demonstrate a procedure. No help is given during the evaluation * 
period. , * 

One .reason for putting the instructions on tape, besides the intent 
to standardize administration, was to minimize the amount of reading abilily 

r 

required. Many tests of special abilities involve a relatively high level of 

« ^ ' ' ' y 
skill in English, although their t)rimary purpose i_s to assess nonverbal skills. 

f • 

By removing the necessity to read English, except where the ability realisti- - 
cally is required, a clearer picture of the; person's nonverbal a^itudes^phould 
enierge. . • 

Correlations betweenlhe Micro-TOWER work samples^'and thesfe 
tests were computed, as were the intercorrelations between the FAS and EAS 
tests. ' • . * ^ ^ ^ . ' 

• ' .' ,^ ■ ■ ■• ... ■ ■• 

The Study » o ' 

The subjects, in this study were 100 adolescents and young adults,, 
who had' been referred to a rehabilitation center in New York City for voca- 
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tional evaluation. During the first week at the center they were given the 
^Micro-TOWER work samples, Intercorrelations amongst the Micro-TOWER 
work samples were computed. Some of the rehabilitation clients were also 
^iven the Fundamental Achievement Series (FAS) Verbal arid Numerical tests, 
published by the Psychological Corporation; arid the Employment Aptitude 
Survey (EAS) Ver|bal Comprehension, Verbal Reasoning, and Spatial 

Visualization. tests', published by Psychological Services, Inc. 

* •* * 

Results and Conclusions 

The correlations are reported in Tables 2-4: Table 2 presents 

•/ > 

the intercorrelations of the Micro-TOWER work samples; Table 3, the 
correlations of the Micro-TOWER work samples with the FAS and EAS tests; 
Table 4, the intej'correlations of the FAS and EAS tests. ^ 

. The f\jist research question was: Do the MicrorTOWER work 
samples measure the aptitudes the publishers cla^m they measu^®? Examina- 
tioli of the correlation matrices indicates that with a few exceptions the work 
samples tend to fit the model ai^outlined in Table 1. 

Fairly 'distinct grouping of tests were noted: Those work samples 
heavily dependent upon verbal skills; those measuring motor skills, and those 
measuring perceptual/spatial skills. The work saAiples in the verbal skills 
ai:ea were Want Ads Comprehension; Message-Taking-^, and Zip Coding. ^ Zip 
Coding was originally designed as a clerical activity in the perceptual-motor 
skills area; however,* examination of the data, was well as observations of 



Examination of the Aptits^es 1" . Evaluation System 



persons 'taking the work sample, suggest that this work sample js probably 
more a measure pf general reasoning ability. 

The work samples that correlated most highly with each other to 
form the motor skills grouping are the same as those in the original model 
outlined in Table Lamp Assembly, Electronic Connector Assembly, and 
^ Bottle Capping and Packing- , ' . 

The nonverbal perceptual/spatial grouping is compcteed oi Blue- 
print Reading and Graphics Illustration, In the modeWhp perceptual skills 
grouping included both spatial and clerical perception. Some restructuring of 
the model may be necessary here, but will wait further analysis based on 
additional data. The-pattem of intercorrelations of the Graphics work sample, 
as expected, reveals a combination of perceptual, motor, and reasoning 
skills. 

In the numerical group. Making Change and Payroll Computatiori 
had aai intercorrelation of , 68. Payroll Computation had' the highest correla- 
tion of any of the work samples wi^th the FAS Numerical test (. 65); "however, 
Making Change only correlated . 29 with that test. It should be noted that the 
FAS Numerical test does have a relatively high correlation with the FAS Verba:i 
test (. 52) and the EAS Verbal Comprehension test (. 67; see Table 4). Thus,- 
the low validity coefficient for Making Change may be I'eflecting the relatively 
high verbal component in the FAS Numerical test. 

The second researc^ question involved the degree to whi^^;Jh-the 
Micrp-TOWfiR work samples are dependent upon verbal ability. Examination 
of Table 3 indicates that verbal ability, as traditionally measured by paper 
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and* pencil tests, has importance in only those Micro-TOWER work samples 
that specifically require verbal skill. Thus, Want Ads and Mess^e T^ng 
correlated , 43 and, 37, respectively, with the FAS Verbal test, and , 49 and 



T 



respectively, .with the EAS Verbal Comprehension test. The Payroll ' 
^a^d Mail Sorting' work samples also had some dependency on verbal compre- ' 
herision (r = , 44); the tasks in both of these work samples^ require some 



I'eading, 



I 



Reasoning ability, as evidenced by the EAS Verbal Reasoning 



,testl. seems" to, play some role in Zip Coding, Graphics Illustration, and Filing 
■ (r 1 . 41, ,40, and^r43, respectively). Correlations were very low between the 
mojtor'Skills work samples and the paper and pencil verbal'tests (ranging from 

-.m to . 20). ~ . . 

m mary ... i 

In general the Micro-TOWER work isamples see^ to ^e measuring 
eifific aptitudes in the areas of verbal, numerical, motor, and- perceptual 
bility. Most of the work samples are measuring specific aptitudes in ^e 
reas of verbal, numerical, motor, and perceptual ability. Most of the work 
samples are measuring primarily those abilities they were designed to measure 
although there are a few, such as Zip Coding, that will have to be reclassified 
in relation to the original model. With the exception of those work samples 
specifically designed to depend in part on verbal ability, the Micro-TOWER 
work samples do not require a high levefof verbal ability., ; 
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Table 1 





Aptitudes Assessed by Micro-TOWER Work Samples 

V ■ 


WORK SAMPLES 


PRIMARY APTITUDE 


MEASURABLE BEHAVIOR 


MOTOR SKILLS . 


Electronic Connector finger dexterity 

Assembly " a 


# of small pins placed in plasticThousing 


Bottle Capping &. 
Packing 


manual dexterity 


• # of bottles capped and packed' ^ 


Lamp Assemblj?" 


motot coordination 


# of hand tool operations performed 
correctly 


. PERCEPTUAL/MOTOR SKILLS 


Filing 


clerical perception/ 
motor coordination • ^ 


#-of sets of Cards filed correctly 


Ma.il Sorting 


clerical perception/ 
' * manual dexterity 


# of envelopes sorted correctly ' ' , 


Graphics 

Illu;5tration 

— * ,t 1. 


motor coordination/v 
* spatial reasoning 


\ 

# of lines drawn ^orrectly using drafting 
tools 



PEI^CEPTUAL^SKILLS / 



Blueprint Reading 
Zip Coding 
Record Checking 



spatial reasoning 
clerical perception 
clerical perception 



# of measurements correctly identified 

based oil reading blueprints 

# of zip codes looked up correctly using 

zip code directory . 

^~ • . 

• # of itemsvchecked correctly ^ 



NUMERICAL SKILLS 



Making Change* 



( 



numerical reasoning & 
figuring cliange 



# of times change is' made correctly for 
a '*sale'* 



for_ ^ 



Payroll Computation 



numerical computation/ ^ , # of cc^rr^ct computations using the, 4 
basic arithmetic skills ^ basic arithmetic operations ■ 

VERBAL SKILLS '* ~ ^ 



Wanteds 

Comprehension 

Message Taking 



verbal comprehension 



# Qf questions about ads anjsvvered ^ 
correctly , * ' 



.verbal comprehension & # of ^essential parts t)f messages ^ ; 
usage ' transcribed correctly from simulated \ 



11 



telephpne calls 



Table 2 v 

Intercorrelations of Wcrg- TOWER Work Samples^ 

FI RCS RCA BR GI PC *MC BOT ELC^LA 

28 19 
36 32 



MT ZC MS 

^ : 



Want Ads 
.Message Taking 
Zip Coding 
Mail Sorting 
pling 

Rcc. Ch. spfeed 
Rec. Ch. acc. 
Blueprint Rdg. 
Graphics 111. 
Payroll Comp»_ 
Making Chahge 
Bottles 
Elec. .CQjin. 
I^amp Assem. 



Q9 HA nf\ 


Do 






DO 


83 75 


80 


' 57 , 


22 


67 


— 71 ■ 


72 


• 65 


27 


63 


-_• r.- . ' 


59 


'67 


25 


52 






0 

' 57 


41 


■ 61 








21 


•54 




f 








to 
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,46 64 5B 



35 



76 



66 38 
57 42 



47 . 69 ' 60 ■ 40 

50 76 ^ 60 30 

54 42 . 58 55 52 

18 24 14 '09- 

67 62 66 39- 



56 69, .50 



68 38 
48 



:41 43 

35 ^ 28 

*24 27 
43 56 

-01 Q5 
34 43 
41 46 . 
26' 35 . 

.34 40 

80 " 76 ' 

— 61 '. 



Note . Subjects were adolescent and young adiilt clients in a rehabilitation center; 
n^varies- 'from 65,-93 "because of missing data'. ' 



^Decimals- omitted. 



ERIC 



12 



, 4 



i 



Table 3 ' 



Correlations 6i Micro-TpWER Work Samples with 
1 " Fundamental Achievement Series (FAS) and 
Employment Aptitude ^rvey (EAS) Tests^ 



— «: 

FAS 



1 



EAS 





Verbal 


i 

Numerical 


Ver^l 
^ Comp. 


Verbal 
Reasoning 


Spatial 
Visualization. 


Want Ads Conjp. 


• ' 43 


(89) 


48 


(54) 


49 


(44) 


39 


(41) 


36 


(73)' 


Message Taking - 


37 


(96) 


: 41 


(59) 


31 


(49) 


18 


(46) 


•31 


(78) 


Payroll Comp. 


39 


W) 


J65 


(51) 


-44 


(42) 


38 


(40) 


33 


(69) 


"^yliOdng Change 


• 28. 


(81) 


29 


m 


21- 


(50) 


21 


(47) 


• 38 


(60)" 


Bottles 


20 


(80) 


. 12 


(49) 


15 


(40) 


15 


(38) 


•31 


(68) 


►Electronic Conn. 


01 


(98) 


07 


(61) 


01 


(51) 


-Ol 


(48) 


07 


(80) 


Lamp Assembly 




(100) 


04 


•(61) 


-02 


(51) 


02 


(48)." 


12 


(82). 


Filing 


,27 


(91) 


45 


(55) ♦ 


25 


(45) 


43 


(42) 


34 


(74) 


Graphics 111. 


, 32 


(46) 


42 


(43) ■ 


30 


(38) 


1 40 


(35) 


45 


(36) 


vMail Sorting 


39 


(83) 


46 


(56) ^ 


44 


(48). 


1 37 


(45) • 


33 


(70) 


Rec. ,Ch. accuracy 


'i 


(&3) 


22 


(56).., 


15 


(48) • 


25 


(45) 


19 




Rec. Ch. speed 


29 


(83) 


34 


(56) 


26 


.(48)- 


' 24 


(45) 


20 


(72) 


Blueprint Reading 


33 


(86j 


50 


(56) 


36 


(48j 


. ' 39 


(45) 


52 


(73) 


Zip Coding 


32 


(81) 

s 


40 


(52) 




(44) 


41 


(42) 


29* 


'(69) 



JWote, Subjects were adolescents and young adult clients in a rehabilitation center; 
. * numbers in parentheses indicate number of persons tested.- 



%)ecimals omitted. 
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Table 4 

Intercorrelations of Fun4amental Achievement Series (FAS) and 

Employment Aptitudfi_Sjirvey (EAS) Tests^ / 



FAS 



EAS 



f 


Verbal 


Numerical • 


Verbal 
Comp. 


Verbal 
Reasoning 


Spatial 
Visualization 


FAS 
Numerical 


52 (61) 






48^(51) 


- 46 (48) 


- 4d((53) 


EAS ' 
Verbal 

Comprehension 


67 (51) 


48 (51) 




30145) 


34.(47)._ „ 


Verbal 
Reasoning 


36 (48) ' 


46 (48) 


30 (45) ^ 


* 


a- 

41 (47) 


Spatial / 
Visualization 


32 (82) 


4"0 (53) 


34 (47)' 

* z 


41 (47) 





Note^ Subjects were adolescents and young adult clients in a rehabilitation center; 
numbers in parentheses indicate number of persons test'ed. 



.^Decimals omitted. 



ERLC 



14 



